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Abstract 

We present simple coding strategies, which are variants of the Schalkwijk-Kailath scheme, for 
communicating rehably over additive white noise channels in the presence of corrupted feedback. More 
specifically, we consider a framework comprising an additive white forward channel and a backward 
link which is used for feedback. We consider two types of corruption mechanisms in the backward link. 
The first is quantization noise, i.e., the encoder receives the quantized values of the past outputs of the 
forward channel. The quantization is uniform, memoryless and time invariant (that is, symbol-by-symbol 
scalar quantization), with bounded quantization error. The second corruption mechanism is an arbitrarily 
distributed additive bounded noise in the backward link. Here we allow symbol-by-symbol encoding 
at the input to the backward channel. We propose simple explicit schemes that guarantee positive 
information rate, in bits per channel use, with positive error exponent. If the forward channel is additive 
white Gaussian then our schemes achieve capacity, in the limit of diminishing amplitude of the noise 
components at the backward link, while guaranteeing that the probability of error converges to zero as 
a doubly exponential function of the block length. Furthermore, if the forward channel is additive white 
Gaussian and the backward link consists of an additive bounded noise channel, with signal-to-noise 
ratio (SNR) constrained symbol-by-symbol encoding, then our schemes are also capacity-achieving in 
the Umit of high SNR. 
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I. Introduction 

That noiseless feedback does not increase the capacity of memoryless channels, but can 
dramatically enhance the reliability and simplicity of the schemes that achieve it, is well known 
since Shannon's work [10]. The assumption of noiseless feedback is an idealization often meant 
to capture communication scenarios where the noise in the backward link is significantly smaller 
than in the forward channel. However, all the known simple schemes for reliable communication 
in the presence of feedback rely heavily on the assumption that the feedback is completely noise- 
free, and break down when noise is introduced into the backward link. 

As a case in point, it was recently shown in [5] that any feedback scheme with linear 
encoding (of which the Schalkwijk-Kailath scheme and its variants are special cases) breaks down 
completely in the presence of additive white noise of arbitrarily small variance in the backward 
link: not only is it impossible to achieve capacity, but, with such schemes it is impossible to 
communicate reliably at any positive information rate. 

It is therefore of primary importance, from both the theoretical and the practical viewpoints, to 
develop channel coding schemes that, by making use of noisy feedback, maintain the simplicity 
of noiseless feedback schemes while achieving a positive rate of reliable communication. It is 
the quest for such schemes that motivates this paper. 

Our main contribution is the derivation of simple coding strategies, which are variants of the 
Schalkwijk-Kailath scheme, for communicating over additive white channels in the presence of 
corrupted feedback. More specifically, we consider two types of corruption mechanisms in the 
backward link: 

• Quantization noise: the encoder receives the quantized values of the past outputs of the 
forward channel. The quantization is uniform, memoryless and time invariant (that is, 
symbol-by- symbol scalar quantization), with bounded quantization error. 

• Additive bounded noise: the noise in the backward link is additive, and has bounded com- 
ponents, but is otherwise arbitrarily distributed. Here we allow symbol-by-symbol encoding 
at the input to the backward channel. 

The coding schemes that we present achieve positive information rate with positive error ex- 
ponent. In addition, if the forward channel is additive white Gaussian then our schemes are 
capacity-achieving, in the limit of diminishing amplitude of the noise components in the backward 



link. Furthermore, if the backward link consists of an additive bounded noise channel, with 
instantaneous encoding, then our schemes are also capacity-achieving in the limit of high SNR 
(in the backward link). We note that the diminishing of the gap to capacity with vanishing noise 
in the backward link is a desired property, not to be taken for granted in light of the negative 
results in [5]. In addition, the probability of error of our coding schemes converges to zero as a 
doubly exponential function of the block length, provided that the forward channel is additive, 
white and Gaussian. As will be seen in subsequent sections, our analysis of the performance of 
the suggested schemes is based on elementary linear systems theory. 

To our knowledge, the impact of noise in the feedback link on fundamental performance 
limits and on explicit schemes that attain them has hitherto received little attention. Exceptions 
are the papers [8], [2] which study the trade-off between reliability and delay in coding for 
discrete memoryless channels with noisy feedback, and suggest concrete coding schemes for 
this scenario. Another exception is the recent [6], which considers the capacity of discrete finite- 
state channels in the presence of non-invertible maps in the feedback link, such as quantization. 
Yet another paper is the aforementioned [5], which is primarily concerned with the impact of 
noise in the backward link on the error exponents. 

The remainder of this paper is structured as follows. Section [ill presents preliminary results 
and definitions, while Section |III| specifies and analyzes a coding scheme in the presence of 
feedback corrupted by bounded additive noise, under the assumption that the noise is observable 
at the decoder. The main results of the paper are presented in Sections HV] and |Vl where we 
describe and analyze coding schemes for the cases where the backward link features uniform 
quantization or bounded additive noise, respectively. The paper ends with conclusions in Section 

lYIl 

Notation: 

• Random variables are represented in large caps, such as Z. 

• Stochastic processes are indexed by the discrete time variable t, like in Xt. We also use X* 
to represent (Xq, . . . , X^), provided that t > 0. If t is a negative integer then we adopt the 
convention that X* is the empty set. 

• A realization of a random variable Z is represented in small caps, such as z. 



(white noise) 



u 



delay 



>©- 



<l>-r 



V. 



V, 



Fig. 1. Basic feedback sclieme. 



II. Preliminary Results and Definitions 

In this Section, we define and analyze a feedback system whose structure is described by the 
diagram of Fig [T] The aforementioned system will be present in the coding schemes proposed 
in subsequent Sections. 

For the remainder of this paper, we consider that Wt is a zero mean and white stochastic 
process of variance cr^ and that Z is a real random variable taking values in [0, 1]. In addition, 
Z and are assumed independent for all t. The feedback noise is a bounded real stochastic 
process whose amplitude has a least upper-bound given by: 

av =^ inf{a G M>o : Prob{\Vt\ > a) = 0,t > 0} 

meaning that the following holds: 

Prob{\Vt\ <av) = l, t>0 

The remaining signals Ut, Yt and Zt are also real stochastic processes. The block represented in 
Fig d by (f)f is an operator that maps Z and f/*^^ into Xt for all t. Similarly, 0f maps y* and 
y* into Zt. The description of the maps 0f and (f)f is given in the following definition. 

Definition 2.1: Given a positive real constant f, the operators (f>r ■ {t,Z,U^^^) i-^ Xt and 
(f)r : {t, y*, y*) I— > Zt, represented in Fig [U are defined as follows: 

Xt = (j)r {t, Z, =^ { ^ ' (1) 

[2-'- -T)Z ift = 

Zt = <\>,{tXX) = \ (2) 

if t = 



Notice that ([T]) has a term, given by 2'*Z, that grows exponentially. However, it should be 
observed that if the feedback loop is closed (see Fig [l]) by using Ut = Xt + Vt + Wt then Xt is 
given by: 

Xt = {2-' - 2') 2-^"(*-*-i) {Wi + Vi) + 2-''Z^ , t>l (3) 

which describes a system that is stable, in the bounded input implies bounded output sense. 
In the absence of backward link noise, i.e. = 0, dl]) and Q are equivalent to the equations 
used in the original work by Schalkwijk-Kailath [9]. An alternative minimum variance control 
interpretation to ([T]) and in the presence of perfect feedback, is given in [3]. In addition, 
the work by [3] extends Schalkwijk-Kailath's algorithm, with perfect feedback, to the multi-user 
case. A general control theoretic framework to feedback capacity is given in [11]. The following 
lemma states a few properties of ([T]) and Q which motivate their use in the construction of 
coding schemes. 

Lemma 2.1: Let cr^, ay and f be given positive real constants. Consider the feedback system 
of Fig [H which is described by ([T])-© in conjunction with the following equations: 

Yt = Xt + Wt (4) 



The following holds: 



Ut = Xt + Vt + Wt (5) 



X, = 2^*(2'--2-'-)(Z,-Z), t>0 (6) 



E[X^] < [awVW^ + ay{2' + 1) + 2-^"*(2^" - 2^^) , t > (7) 
If Wt is zero-mean, white and Gaussian, with variance a^, then the following holds: 



Proh{\Xt\ >a)<e a > 0, t > (8) 

where 7 and (3 are the following positive real constants: 



7 + l)ay + T - 2-' (9) 



a' t/ - 1) 



(10) 



Proof: In order to derive Q, we substitute Ut = Vt + Yt in (O. We now proceed to proving 
the validity of Q. Since the operators 0f and (pr are linear, we can bound the variance of Xt 
by separately quantifying the contribution of the external inputs Z, Wt and Vt. By making use 
of the triangular inequality, we arrive at the following bound: 

{E[X^]Y^^ < ( a^^^ [ \T{e^'^)\^diu]^ +av max \T {e^'^)] + 2~'\2' - 2-') (11) 
where T {e^"^) is the following transfer function: 

o— f of 

T (e^^) = . (12) 

The transfer function T {e?'^') describes the input-output behavior of the feedback loop from Vt 
to Xt and from Wt to Xt. The first term in the right hand side of (fTTT) quantifies the contribution 
from the white process Wt, while the second term is an upper-bound to the contribution of Vt 
and the last term comes from the initial condition determined by Z. Standard computations lead 
to the following results: 

— / |T(e^'")|'c/u; = 22"-l (13) 



max 

7r,7r] 



\T{e^-)\ = ^-^ = T + l (14) 

After substituting (fT3b and (O in dTTT) . we arrive at In order to prove dSt- lflOb . under the 
assumption that Wt is zero mean white Gaussian, we define the following auxiliary Gaussian 
process: 

{0 if t = 

(15) 
{2-^ _ 2^") Y!r}^ 2-^^^-^-^^Wi if t > 1 

After simple manipulations, similar to the ones leading to (fr3t - (fT4b . we get the following 
properties of Xt. 

E\Xl\ = {2'^ - 1) (1 - 2-2^-*) < (3' (16) 



\Xt - Xt\ < {r - 2'') [^v]-^^ + 2-''^ < 7 (17) 
where we used the definitions ® and (flUI) along with ©. Consequently, we arrive at: 

Proh{\Xt\>a)<Proh(\Xt\>a--i^<^j~^j e~^dii,a>Q (18) 



where we used the facts that, by definition, \Xt — Xt\ < 7, that < (3"^ and that Xt is 

normally distributed. The derivation of dH) is complete once we use the following upper-bound 
[7, page 220 eq. (5.1.8)]: 

□ 

III. A CODING SCHEME WITH FEEDBACK 

In this Section, we describe a coding scheme in the presence of feedback according to the 
framework of Fig|2l where (j)f and (j)f are defined by (IT])-©^ while the maps 6'„ ^ and ^„ will be 
defined below. Notice that the scheme of Fig |2l assumes that 0f has direct access to the feedback 
noise Vt. Under such an assumption, in this Section we construct an efficient and simple coding 
and decoding scheme which will be used as a basic building block in the rest of the paper. In 
Section |lVl we use the fact that if the backward link is corrupted by uniform quantization then, in 
fact, Vt is the quantization error which can be recovered from the output of the forward channel 
and used as an input to 0f . Finally, in Section |Vl we show that bounded noise in the feedback 
link can be dealt with by using a modification of the quantized feedback framework of Section 
Hvl It should be noted that in the schemes presented in Sections |lVl and |Vl the decoder relies 
solely on the output of the forward channel. 

The main result of this Section is stated in Theorem 13.21 where we compute a rate of reliable^ 
transmission, in bits per channel use, which is achievable by the scheme of Fig|2l in the presence 
of a power constraint at the input of the forward channel. Such a transmission rate is a function 
of the parameters cr^, ay and it also depends on the forward channel's input power constraint, 
which we denote as P|. Theorem 13.21 also provides a lower bound on the error exponent of 
the resulting scheme. If the forward channel is additive, white and Gaussian then Theorem 13.21 
shows that the probability of error of the scheme of Fig |2l decreases as a doubly exponential 
function of the block length. 

We start with the following definitions of the ceiling and floor functions denoted by 6 and 
0, respectively. 

G(a) =^ min{n e N : a < n}, a G M (20) 

'By reliable transmission we mean that the probability of error converges to zero with increasing block length n. 
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Fig. 2. Basic feedback sclieme witli encoding and decoding. 



e(a) =^ max{n G N : a > n}, a G R (21) 

The following definition specifies the maps 9n,r and 6n,r represented in Fig |2l 

Definition 3.1: Given a positive integer n, a positive real constant r, a random variable M 

taking values in the set {1, . . . ,2®*^'"^} and a real stochastic process Zt, the following is the 

definition of the maps 9n,r : M ^ Z and 9n,r '■ Zt^ Mt'- 

Z = On AM) = - 2-®('-") (22) 

Mi = ^„,,(Zi) =^ e (2®('^*)Z,) , t G {0, . . . , n} (23) 
For the remainder of this paper, n denotes the block length of the coding schemes and r 
represents a design parameter that quantifies the desired information rate, in bits per channel 
use. The following equations, describing the coding scheme of Fig|2l will be used in the statement 
of Lemma 13.11 and Theorem 13.21 

Mt = enA^fiiX^y')] (24) 



Yt = Wt + <P, {t, e^^M), (25) 

V ' 

Xt 



Ut = Y, + Vt 



(26) 



Lemma 3.1: Let cr^, ay and f be given positive real parameters. Consider that the block 
length is given by a positive integer n, that the desired transmission rate is a positive real 
number r strictly less than f and that M is a random variable arbitrarily distributed in the set 
{1, . . . , 2®(''")}. If we adopt the scheme of Fig|2l alternatively described by (l24b - (l26b . then the 
following holds: 

Prob (m ^ M„ ) < ,,,, ,1;^ (27) 



4(2^ - 2-^)2 

If Wt is zero mean, white and Gaussian with variance cr^ then the following doubly exponential 
decay, with increasing block size n, of the probability of error holds: 



where 7 and (5 are positive real constants given by ^ and (flOb . respectively. 

Proof: We start by using and the fact that 2®(™)Z is in the set {i, . 

to conclude the following: 

1 



leading to: 



Proh [M =^ Mn) < Prob 



< 



Z — Zr. 



M = M„ 



> 2-(0(^'^)+i)'\ 



(28) 



(29) 



(30) 



Using (l30b and the fact that 6(rn) < rn, we get: 



Prob {m ^ < Prob > 2(2"" - 2-"")2(""-'')") 



(31) 



The inequality (ITTl) follows from Markov's inequality applied to (OTl . Finally, the inequality 
(Ei) follows from (EH) and ©. □ 



A. Lower-bounds on the achievable rate of reliable transmission in the presence of a power 
constraint at the input of the forward channel 

Below, we define a function that quantifies an achievable rate of reliable transmission for the 
scheme of Fig |2l in the presence of a power constraint at the input of the forward channel. 



Definition 3.2: For every choice of positive real parameters cr^, F|- and ay satisfying 4(jy < 
Px, define a function g : (a^, F|, ay) i-^ ]R>o as the non-negative real solution g of the 
following equation: 

awV2^^ - 1 = Fx - (1 + 2^) (32) 
If, instead, Aa^ > then g{a^y, Px, ay) = 0. 

It is readily verifiable that a non-negative real solution of (l32t . in terms of g, exists and is unique, 
provided that cr^ and P|- are strictly positive and that 4ay is less or equal than P|-. 

Theorem 3.2: Let a^^, P|- and ay be given positive real parameters satisfying 4ay < Px- 
In addition, select a positive transmission rate r and a positive real constant f satisfying r < 
f < ^(a^, P|-, ay). For every positive integer block length n the coding scheme of Fig |2l 
alternatively described by (l24ll - (l26t . leads to: 

E[X^] < Ipx+ ^^(2^^-22^ j , < t < n (33) 

\ vanishes with increasing t/ 

Prob (M ^Mn] < ——. ^ (34) 

where M is a random variable arbitrarily distributed in the set {1, . . . ^2®*^"''^}. If Wt is zero 
mean, white and Gaussian with variance a^ then the following doubly exponential decay, with 
increasing block size n, of the probability of error holds: 

Prob [m ^ Mr?j < e-i^(2(2'--2-'-)2('-'-)--7)'^ ^ > Q (35^ 

where 7 and (3 are positive real constants given by ^ and (flOt . respectively. 

Theorem 13.21 shows that the scheme of Fig |2l under the constraint that the time average of 
the second moment of Xt is less or equaP than P|-, allows for reliable transmission at any rate 
r strictly less than g{a'^r, Px, ay). In addition. Theorem 13.21 shows that any rate of transmission 
r, if strictly less than g{a'y/, Px.ay), leads to an achievable error exponent arbitrarily close to 
2 [r — ^(a^, Px, (^v)]- In addition. Theorem 13.21 shows that if the forward channel is additive. 



^See inequality <33> . 



white and Gaussian then the probability of error decreases with the block length n at a doubly 
exponential rate (see (l35t ). 

Proof of Theorem \3.2l The inequalities (1^ and (B51) follow directly from Lemma I3.1[ The 
derivation of (l33t follows from ^ and from the fact that, from Definition l3.21 f < g{(J^, P|, ay) 
implies that awV^^^^ + av(2*' + 1) < P^- □ 

It follows from its definition, as the solution to &2\i . that ^(cr^, P|, ay) also satisfies the 
following 3 properties: 

lim g{al,, ay) = ^ \og^ f 1 + > 0, Pi > (36) 

g (^(T^, Pi, 5^ = 0, > 0, Pi > (37) 

g{a^, Pi, av) ^ loga ( — ) , ^1 » max{a^, a^}, (38) 

where ~ indicates that the ratio between the left and right hand sides of (l38t tends to 1 as 
Px CO. If Wt is white Gaussian then (B^ indicates that in the limit, as the second moment 
of feedback noise goes to zero, the scheme of Fig |2l approaches capacity^. We have computed 
g{a^,Px,av) for a"^ = 1, Pi = 4 and one thousand equally spaced values of ay, ranging 
from zero to one and the results are plotted in Fig |3l The plot illustrates a graceful (continuous) 
degradation of ^(1, 4, ay) as a function of ay, going from the highest rate of | loga 5, achieving 
capacity when Wt is Gaussian, down to zero when ay = 1, which is consistent with (l36b and 
dTTl . respectively. 

IV. Specification of a coding scheme using uniformly quantized feedback 

In this Section, we consider the scheme of Fig|4l where represents a memoryless uniform 
quantizer with sensitivity ay and Ag.^ gives the associated quantization error. The main result 
of this Section is Corollary 14.11 where we indicate that the results of Section |III| hold in the 
presence of uniformly quantized feedback. Notice that the diagram of Fig |4l follows from Fig |2l 
by adopting Vt as the quantization error, which the decoder re-constructs by making use of A^^^ 

^It is a standard fact [1] that the capacity in bits per channel use of an additive Gaussian channel, with noise variance 
and input power constraint Px, is given by i logj fl + ^^)- 
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Fig. 3. Plot of Q{aiv, Px,^v) using cr^ = 1, = 4 and ay G [0, 1]. 
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Fig. 4. A coding and decoding scheme in the presence of uniformly quantized feedback. 



applied to the output of the forward channel. The precise definitions of the uniform quantizer 
and of the quantization error function A^^, are given below: 
Definition 4.1: Given a positive real parameter b, a uniform quantizer with sensitivity 6 is a 
function $5 : M ^ M defined as: 

My) = 2&e (^^) (39) 

where O is the fioor function specified in (OTT) . Similarly, the quantization error is given by the 
following function: 

which satisfies the following bound: 

\A,{y)\<b,yeR (41) 



The coding scheme of Fig |4l can be equivalently expressed by the following equations'^: 

Mt = 0n,r[Mt,y'^y')) (42) 



Yt = Wt + (f>r{t,9nAM),U'-') 



(43) 



Xt 



Ut = <i>^^{Yt) = Yt + Vt 



(44) 



Vt = A^,{Yt) (45) 

The Corollary below follows directly from Theorem 13.21 applied to the scheme of Fig HI along 
with the upper-bound (|4TT) . 

Corollary 4.1: Let a^,, P| and ay be positive real constants satisfying Aay < P|, where ay 
represents the sensitivity of the quantizer. In addition, select a positive transmission rate r and 
a positive real constant f satisfying r < f < f?(cr^, a^). For every positive integer block 
length n, the coding scheme specified by (l42b - (l45t (see Fig ^ leads to: 




E[X'^] < \ Px+ T^if^-T^ I , < t < n (46) 

vanishes with increasing t 

Proh (M^Mn) < ——- ^ (47) 

where M is a random variable arbitrarily distributed in the set {1, . . . ,2®^"^')}. If Wt is zero 
mean, white and Gaussian with variance then the following doubly exponential decay, with 
increasing block size n, of the probability of error holds: 

Proh (m ^ Mn] < e-5|2(2(2--2-')2('--)"-7)' (4g) 



where 7 and /3 are positive real constants given by ^ and (flOb . respectively. 

Notice that Corollary 14.11 shows that, in the presence of uniformly quantized feedback with 
sensitivity ay, any rate r strictly less than g{aiY , Px , (Ty) allows for reliable transmission. This 



''Some of these equations have been used before, but we repeat them here for convenience. 
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Fig. 5. Communication scheme in the presence of bounded feedback noise. 



implies that the properties (l36b - (l37t . along with the conclusions derived in Section Unl hold for 
uniformly quantized feedback. In particular, the achievable rate of reliable transmission of the 
coding scheme of Fig |4| degrades gracefully as a continuous function of the quantizer sensitivity 
ay (see the numerical example portrayed in Fig |3l). 

V. Coding and decoding in the presence of feedback corrupted by bounded 

NOISE. 

From Corollary 14.11 we conclude that there exist simple explicit coding strategies based on 
Schalkwijk-Kailath's framework that, even in the presence of uniformly quantized feedback, 
provide positive rates with positive error exponents. In this Section, we aim at designing coding 
schemes in the presence of feedback corrupted by bounded noise. The main result of this Section 



is discussed in Section IV-AI where we describe a communication scheme whose structure is that 
of Fig |5l In addition, we analyze the performance of such a scheme in the presence of power 
constraints at the input of the forward and backward channels. The proposed scheme retains the 
simplicity of the Schalkwijk-Kailath scheme [9], but, in contrast to the original scheme (which 
breaks down in the presence of noise in the backward link [9, Section III.D]), achieves a positive 
rate of reliable communication and is in fact capacity achieving in the limit of high SNR in the 
backward link (assuming white Gaussian noise in the forward channel). The scheme proposed 
in Section IV-AI also guarantees that, if the forward channel is additive, white and Gaussian, then 
the probability of error converges to zero as a doubly exponential function of the block length. 
The main results of this Section are stated in Theorem 15.11 
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Fig. 6. Schematic representation of the equivalence expressed in Remarlc l5!T1 
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A. Performance in the presence of a power constraint at the input of the backward channel. 

For the remainder of this Section, we will define a coding scheme whose structure is that 
of Fig |5] The additive noise St in the feedback link is arbitrarily distributed, bounded and the 
tightest upper-bound to its amplitude is defined below: 



_ def . p r 

as = mfjo! G 



meaning that the following holds: 



: Proh{\St\ > a) = 0,t > 0} 



Proh{\St\ <os) = l, t > 

The following remark will be used in the construction of a coding scheme with the structure 
of Fig El 

Remark 5.1: Let og be a positive real constant and St be a real valued stochastic process 
satisfying \St\ < as with probability one. Given a positive real parameter ay, the following 
holds with probability one: 



where Qt is given by: 



{St + Qt) = <^,AYt) 



(49) 



Qt = ^Yt (50) 

\(^v J 

The schematic representation of the equivalence expressed in Remark 15711 is displayed in Fig|6J 

In such a scheme, St is the bounded additive noise at the backward channel with input Qt. 

Aiming at constructing a coding scheme according to the structure of Fig |5l we use Remark 

5.11 to obtain a new coding strategy by substituting the feedback quantizer of Fig |4| with 

the equivalent additive noise channel diagram of Fig |6l The resulting scheme, along with the 

encoding and decoding strategy of Section HVl provides a solution to the problem of designing 

encoders and decoders in the presence of an additive (bounded) noise backward channel (see 
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Fig. 7. Proposed coding scheme for dealing with the feedback corruption that results from additive noise St in the backward 
channel. The scheme is constructed by replacing the quantizer in the diagram of Fig |4| with the scheme of Fig|6| The encoder 
and decoder blocks are described in detail in Fig|4| 



Fig El). Under such a design strategy, ay becomes a design parameter. Notice that viewing ay as 
a design knob is in contrast with the framework of Section |TV1 where ay was a given constant. 

Regarding the role of ay, we have shown in (OHt that as ay approaches zero the achievable 
rate of reliable transmission converges to a positive value, which, in the case where Wt is white 
Gaussian, coincides with capacity. However, for any given positive real as, the smaller ay the 
larger the scaling constant ^ in (I5UI) and that may lead to Qt having an arbitrarily large second 
moment. In Theorem 15.11 we show that the function defined below solves the aforementioned 
problem by providing a suitable choice for ay, in the presence of power constraints at the input 
of the forward and backward channels. 

Definition 5.1: Let aw, (75, Px and Pq be given positive real constants, where Pq symbolizes 
a power constraint at the input of the backward channel Qt. Below, we define the function 
r : ]R>Q — > M>o, which we will use as a selection for the design parameter ay: 

r {aw, as, Px, Pq) = {Px + (^w) 77^^, Pq > ^5 (51) 

Pq - (^s 

The following Theorem is one of the main results of this paper. 

Theorem 5.1: Let a^, P|-, Pq and as be positive constants satisfying 4r {a-w, (^s, Px, Pq)^ < 
P|- and as < Pq. In addition, select a positive transmission rate r and a positive real constant 
f satisfying r < f < Q{a^, P|, o-y)|- - p y For every positive integer block length 



n 



, the coding scheme of Fig |71 alternatively described by (l42t - (l45l) and dSOb . leads to: 



E[Xt] < 



\ 



Px+ 2-""* (2"" - 2""") 
\ ^ ^ ' / 

\ vanishes with increasing 1 1 



, < t < n 



\ 



Px + Ow 



v 



< t < n 



vanishes with increasing t 



J 



Prob M ^ M„ < 



2-2(^-^)"E[X, 



(52) 



(53) 



(54) 



4(2f= - 2-^)2 

where M is a random variable arbitrarily distributed in the set {1, . . . ,2®*^"''^}. If Wt is zero 
mean, white and Gaussian with variance a^^r then the following doubly exponential decay, with 
increasing block size n, of the probability of error holds: 



Prob [M ^ Mn] <e 



_1^^2{2''-2-'')2(''-'')"-7)^ 



(55) 



where 7 and (3 are positive real constants given by ® and (fTUt . respectively, where ay is given 
by the assumed selection o-y = F {ow, o'sjPx, Pq)- 

Proof: The inequalities (l52b . (l54l) and (l55t follow directly from Corollary 14.11 In order to 
arrive at (15^ . we start by noticing that we can use the triangular inequality to find the following 
inequalities: 

{E[Y,'])'- < {E[Xf]y^ + aw (56) 



In addition, substitution of (l56t in (l57t . leads to: 



(57) 



E[g2]< (^(£;[x2]5 + cr^)+cr5 



which, from (l52b . implies the following: 

E[Q',] < {Px + 2''' [2' - 2-') + aw) + crs^ 



(58) 



(59) 



1.5 

I 1 
0.5 



0.2 0.4 0.6 0.8 — 1 

Fig. 8. Plot of e(cr^,-Pl,o-v)|-^^j,(^^ using = 1, = 4 and as £ [0, 1), for Pq taking values 1, 2, 4 

and 8. 

The proof is complete since (l53t follows by substituting our choice ay = F {aw, (^s,Px,Pq) 
in (EH). □ 

Under the conditions of Theorem 15.11 including our choice of the design parameter ay, the 
following limit holds: 

1 / p2 \ 

^lim^ ^(^^'^l'^v)|^^=r(.^,.„P,,P^) = 2 [l + ^j, crw>0,Px>0,PQ>0 (60) 

Notice that (l60b leads to the conclusion that, under our choice of ay, the performance of the 
scheme of Theorem 15.11 (see Fig ^ degrades gracefully as a function of 0-5, in terms of both 
the rate and the error exponent. If Wt is white Gaussian then (l60b indicates that as as tends 
to zero, the scheme of Theorem 15.11 can be used to reliably communicate at a rate arbitrarily 
close to capacity. Moreover, such a conclusion holds in the presence of an arbitrarily low power 
constraint at the backward channel. The plot of Fig [H displays how the achievable rate changes 
as a function of as, under the choice ay = T {aw, o^s, Px, Pq)- Such a plot also illustrates that 
by increasing Pq we can reduce the sensitivity of the achievable rate, of reliable transmission, 
relative to variations in as- 




(white noise) ]y 



M 



encoder 



U 



f-i 



a. 



delay 



Y 

feedback 
decoder 



decoder 



M 



feedback 
encoder 



Fig. 9. A coding scheme equivalent to the one described by Fig|7| 



B. Further comments on the location of the one-step feedback delay 

In the framework of Fig |7l the one-step delay block is located after the feedback decoder. 
However, we should stress that, since the feedback decoder is time-invariant, our coding scheme 
would be unaltered if we had placed the delay block before as indicated in Fig |9l Indeed, the 
diagrams of Fig |7] and |9l are equivalent, implying that Theorem 15.11 holds also for the coding 
scheme of Fig |9l 

VI. Conclusions 

We derived simple schemes for reliable communication over a white noise forward channel, in 
the presence of corrupted feedback. Both the case of uniform quantization noise and the case of 
additive bounded noise in the backward link were considered, where, in the latter case, encoding 
at the input to the backward channel is allowed. The schemes were seen to achieve a positive 
rate of reliable communication, and in fact be capacity-achieving in the presence of an additive 
white Gaussian forward channel, in the limit of small noise (or high SNR when encoding is 
allowed) in the backward link. In addition, still under the assumption that the forward channel is 
additive white Gaussian, the proposed schemes guarantee that the probability of error converges 
to zero as a doubly exponential function of the block length. 

We believe that our approach to the construction and analysis of coding schemes carries over 
naturally to the case where the noise in the forward channel is non-white. In this case, we expect 
to obtain variations on the schemes in [4] that are analogous to those in the present work and 
whose gap to capacity behaves similarly. 
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